SO 009 873 

Hieting, Stephen G, 

Simulated Jesaarcji Ixperieaces for Teaching lesearch 
Hethoaologj! Sone Idncational Computing 
Implications, 
76 

29p.| Paper presented at Innual Meeting of the 
Anerican Sociological Association (New York, Hew 
York, lugust 30-Septentoer 3, 1976) 

HP-S0.83 HC-*2*06 Plus Postage. 

♦Coflputer issisted Instruction i Coaputersi Decision 
flaking Skills; iducational Bnvironmeati Bducational 
Games; Iducational Eesearchi Higher Iducationi 
Instructional Inprovaments learning Characteristics ; 
learning Ijeperiencei *lesearch Hethodplogyi 
*Siaulationi *Sociologyi student Ittitudes; lailes 
(DataJ i ieacher Develo^d Materials j ieaching 
Methods; *Ieaching Technigues 



amhiguities surrounding coaputer simulations in 
sociology teaching and research on the uniTersity level are described 
and the implications o£ computers as a teaching technigue are 
explored. Intended as an expiaaation to sociology teachers and 
researchers of hos students* learning experiences are shaped by their 
orientations to coaputer enFironments, departmental organization, and 
university organization, the paper is presented in three sections. 
Section I discusses the relationship between using the computer for 
educational purposes and sociological theory. Simulation examples and 
observations on educational environments are given, S,ection li 
presents reasons why coaputer usage is a particularly suitable topic 
for educational research, leasons include the eompatability of 
coaputer technology with both teaching and research and evidence that 
students improve decision-making skills when trained in computer 
simulations. There are also indications that participation in 
coaputer simulations contributes to development of basic sociological 
knowledge which, in turn, facilitates learning of sociological 
theory. Section III discusses computer usage by t^e reformist element 
in fiociology within the framework of statements by sociologist "~™ 
Hilbert Moore. lables, a guestionnaire of student attitudes toward 
research methodology, and references dealing with .sociology 
education, simulations, student evaluations, and computerized 
education are included. (Author/DB) 

* Documents acguired by iiic include many informal unpublished * 

* materials not available from other sources. fllC makes every effort * 

* to obtain the best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the guality * 

* of the microfiche and hardcopy reproductions lElC makes available * 

* via the IsiC Document Reproduction Service (IDBS) , IDHS is not * 

* responsible for the guality of the original document, leproductions * 
♦supplied by IDBS are the best that can be made from the original. * 



ID 137 162 

IDMOfi 
ZISI.1 



NOTE 



BDBS PEICE 
DBSCEIPIoaS 



IBSIBACT 



0 

ERIC 



eK% MiTieNALlMiTlTUTlQF 



^ - THIS WCUMINT H^^^g-^ITVID F«OM 

^ THE PiH^ON tffgw oa ePlNlDNS 

STATl D NOT 



UJ 



SIMULATED RESEARCH EXPERIENCES FOR TEACHING ^SEARCH ^IITHODOLOGY ; 



SOME EDUCATIONAL COOTUTING DffLlCATIONS ^ 



Stephen 6, Wleting 
Department of Sociology 
University of Iowa 



Prepared for presentation during the annual meetings of the Merican 
Sociological Association J New York, Falls 1976, 



2 



Introduction 

Thasa comoaents reprenent a retrospect of four years of effort 
daveloplng computer applications for undergraduates in sociology. 
The material priinarily coraes from experiences in the development and 
implementation of one specific package. SIMSEMtCH is a pactoge of six 
simulations devoted to decision making in research* The sifflulations 
are about resaarch in the areas of generational conflict ^ family ^ sporty 
deviance s culture of poverty , and sex roles* They are used in an 
undergraduate methods course* The material ^ however^ reflects more 
generally eKperiences .as they have been shaped by students' overall 
orientations to computer environment s, departmental organlzationi and 
university organisation* My Intention is thuj tw^foldi to provide 
further description of the slmulat ions (other aspeccs of which were 
reported in Wietingj 1975), but also to explore tJie organizational 
Implications of this line of work. At the outset of this educational 
computing project a premium was placed on the definition of computers 
and education being a social organizational Issue instead of being a 
technical or individualistic concern* Theraforas any work donej it was 
feltsShould reflect and add to the general ynderatanding of the social 
organisation of computing and education* This statement Is, then, an 
attempt to be consistent with that priority* In the earlier paper 
mentioned, I spoke of the organisational aspects of the specific educational 
enviromaent constructed | here I extend this to Issues of interface with 
other facets of the educational institution* The polnte of interface 
examined are sociological theory and educational computings teaching and 
research in a university setting; and the reformist element In educntion«l 
computing* 
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I. Educational Computing and SoGlologieal Theory 

In 1972, a group of undergraduates taking a methods course and I 
spent a semester meeting periodically to discuss the Incorporation of 
practical experiences into this required methods course. Three criteria 
for such an experience were cited i 

(a) the capacity to underatand and do research is a combination of 
knowledge and skill ™ and hence practical exposure of some sort 
is required; 

(b) the experience should provide iimedlate feedback on the 
consequences of research decisions made in the practical setting | 

(c) the experience should allow students more easily to learn and 
advance in studies of research teclmlques at their own pace. 

The alternative that was agreed on was a research simulation. This would 

simulate the principles of research practice 5 meet the committee 

requirements for the practical part of the course 5 and operate without the 

liabilities of actual research* After a period of development and testings 

six computer simulations were produced* 

In addition to this student specif Icatian of this experience^ an 

effort was made to* ground the development and implementation in some 

sociological theory of educational settings. Having been introduced to the 

work of 0*K* Moore and A,R» Mderson (1969) and ImpresBed by its 

comprehensiveness and quality, it was used. Central to the design facets 

articulated by Moore and Anderson is their assessment of social change in the 

past thirty years and the implications of the change for the quality of ' 

educational experiences to which individuals' in contemporary society should 

have access. They contend that prior to WWII the nature of Information in 

Induatrlal spcletles was relatively static and finite 1 such a society they 

term a performance society . Since that period, in their view, an essentially 



dynaffiic kind of information has devalopedj which they say has ciade today's 
society a learning society > The basic shift in quality requires that 
peraons be educated In contemporary social settings in a different manner 
than through the procedures considered appropriate for the perforaance 
society* In order adequately to train persons for this quality of life 
it is incumbent on educators to structure learning conteKts possessing 
the logical and empirical Outcomes required by society. 

The structures they propose are based on four educational principles. 
The firsts the perspectives princlplep seeks to provide a range of 
perspectives or roles for the learner* That iSp rather than be a passive 
receptor of sociological knowledge (the patient perspeetive or role), the 
setting should also provide training in the perspectives of agent, strategist , 
and referee* The second^ the autctelic principle, refers to the sanction 
system of the learning environment* In order actualiy to effect the quality 
and extent of problem-solving practice and creative decision-making 
desired, the enviromaent must be as free as possible from threats and sanctions 
which are baaed on factors ^traneous to the activity of the students* 
The productivity principle (the third) refers to the learning facet that an 
optimai conteKt predisposes toward problOT--solvlng and cognitive gtQ%^th when 
elements of information wholes are presented to stadents but not completed for 
them. The fourth, the personalisation principle, refers to Moore and 
Andeirson's view that the environment will provide freedom fcr eKploration, 
rapid feedback, and the opportunity for self -pacing.''' 

In order to concretise these principles, an experience was provided for 
students that itwolved progressing through the decision making that occurs 
in , the six stspa of r<Kaearchi foraation of a problan; theory; saroplingi 
design of proof; measurement ; and analysis. General properties of the 



simulations have been described in another conteKt; here a more detailed 
picture will be provided by presenting some of the substantive material 
that comprises the simulations and is exchanged in the interactive setting 
involving the student and the computer through a remote terminal access. 
At each decision point (e.g*, problems theory^ etc.)* a range of alternatives 
is provided* If the student selects the correct option he or she receives 
feedback on the reason for the appropriateness of the choice* Then the 
computer proceeds to the next decision point and provides the array of 
alternatives to the student. If an Incorrect alternative is selected, 
the student is given an explanation of the weakness of -the alternative and 
another selection is made. The student in the simulation is asked to 
assume that unless otherwise specified he or she will have one year to 
complete the research and $1000*00 in financial resources for the research* 

The auto telle principle is described by Itoore and Anderson in this 
way (1969:587) I For an environment to be autotelic it must protect its 
denizens against serious consequences so that the goings on within it can 
be enjoyed for their own sake," This was translated to mean that some real event 
(which could be serious in its consequences) is conveyed to the student 
in a factually non='threatening situation but where the prospect of dealing 
with the \vent is an Inherently Interesting one. One example might be this 
exchange from the simulation on the culture of poverty (POVCUL) whare the 
"researcher'' is posed the possibility of influences from certain groups 
in the research site and this situation must be resolved. Here the 
"reeearcher" is undertaking an extended period of ethnographic field study 
in a depressed urban area* 
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>k_teriaj._ Presented Student 



V, UNEXPECTED OCCURRENCE 

After you have lived in the urban area for two months , you are contacted 
by a local group of older residents. They have heard of your study. They 
will be willing to assist you and help you gain access to needed inforamtion. 
However in return they want you to find out the level of drug use and 
crime among the younger segments of the culture- What would you do? 

1. Leave the area and stop the research. 

2* Agree to assist thM as you need the information they promise. 

3. Use this chance to solidify trust among the young segments by telling 
of the influence attempt. 

4. Ignore this Influence* 

Range of Response to the Student^ Qontlngent on Selecting Any of the 

Four Possible Mter natives (Here, -'4" is considered the most appropriate,) 

Response to "1" 

The information does not suggest so extreme a reaction is called for. 
You are not endangered necessarily* To leave My undemine the credibility 
of your research generally* And you would have lost two months investment 
of time and money* 

Response to_ "2" 

This may give you access to some information* However , you may lose 
the trust of other segments of the area* AlsOj you lose control over the 
conditions and write-"Up of your research. These last factors would almost 
in every case outweigh the gains of assisting the interest group* 

Response to "3" 

Even though you may gain and solidify trust with the youth * you will 
alienate the older group* Since your study will be concerned with a 
descriptive picture of the whole community, you likely cannot afford to do 
this* / 

Response to "4" 

GOOD SELECTION. There are risks here. But you need to make this 
choice to avoid alienating the youth in the research area and to retain 
autonomy in conducting the research. 
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toore and ^derson' s productive principle Is probably the most 
difficult to incorporate into an educational envlromnent and the most 
difficult of the four to illustrate. Basically the princlpla is oriented 
to teaching students how to draw implications or make deductions from 
having been presented information that allows some Inferances to be drawn*^^. 
The infomation needs to be presented in such a way tKat it is partial 
but it conveys its rules of constitution so that the student can "go on'" 
(in Wittgenstein's sense) or draw the implication embedded* 

The decision point where particular effort has been made at being 
"productive" is in the step concerned with the selection of the research 
problem. The judgment has been that problem selection is very difficult 
because it entails determining what is not prbvlded in the lltaratura. 
It requires the researcher to follow a pattern of creacive development in 
research (available through a review of the literature) and to take the 
logical n^t step. The task is not to dp the same thing as has been donei 
nor is it to do something radically different 5 that is, out of phase of 
the logical (or at least orderly) progression of the research. Sometimes 
the problem implied will be a replication ^ sometimes a study using a 
different sample^ sometimes a study using a different method , sometimes 
a study allowing a test of two competing theories. In the eKchange that 
follows^ from SUGRLEs information Is presented the student in encapsulated 
foTO drawn from an extensive literature review. The information is structured 
to allow the student to draw an implication about a logical next step 
for some research • 
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Material Presented to Student 
BACKGROUND 

A univarsity faculty group has just formed a union and Is building a 
staff to administer it, handle public relations, and handle arbitrations. 
In all caseSi the staffing is being done very carefully* One of the most 
difficult Jobs to fill Is an arbitration post. What is needed is one who 
can deal effectively with public sentiment about teachers unionising, 
^ the university administration, and the faculty* The person has to have 
excellent skills in person perception and the facility to assume a variety 
of roles* 

An initial decision that will be made in terms of relevant characteristics 
for the person is whether to hire a man or a woman* The hiring group 
decides tc look at some sex role research to determine whether women or men 
would be, in general, more suited for the Job* Wiat they find is a set 
of two conclusions. Each is bolstered by a well-developed theory. Itowever,^ 
one theory and the aligned research tradition suggest women would be the 
best for the job. Another theory and body of research suggest men wjuld fit 
the Job specifications better* Faced with these contrasting conclusions, 
the conmittee has called you in to decide on some research that would 
resolve the contradiction and provide confiming evidence on the value of 
hiring either a man or a woman* 

V^en you examine the theory and researchp this is what you find* 
A, Theory A suggests that skill in a range of situations and empathy 
in a range of role relationships depends on the number of '*role preparations*', 
the person had as a child. In other words, if a person had a varied and wide- 
ranging series of roles as a child the person would be a better bet for 
the Job* In our culture where mles are generally pushed toward independence 
and mastery of new situations more than fCTales, this would in general suggest 
that males would be more likely to have the skills required* 

B* Theory B, in contrast to Theory A, BUggastfi that paopla in interaction 
operate to maintain parity or advantage and use those skills that they have to 
do this* People who are culturally or bureaucrat Ically defined as powerful 
use this definition to advantage in dealing with others. However * people 
who are culturally or bureaucrat leal ly defined as subordinate in some social 
setting develop alternative skills for influence and control in the 
interaction* Some of these are greater facility in person perception and 
greater role taking and empathlc ability* Because our society often culturally 
defines women s.nd somettnes bureaucrat ically defines women in a subordinate 
status, this theory implies women are more apt to have these skills (i*e*s 
person perception and role taking ability) than men. In that these are skills 
related to the Job requirements, a woman should be hired. 

I. PROBLiM 

1* A study of contemporary American cultural stereotypes of men and women. 

2* A study of collective bargaining power of males and f males. 

3* A test of the hypothesis about mpathy and person perception from 

relative subordinate status* ^ 
4. A test of alternatlva hypotheses drawn from the two eKplanatlons. 
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Range of Responsa to the Student, Continuant on Selecting Any of the 

Four Possible Alte r natives CBbtBm "4'' is consldared the most appropriate.) 

Response to "1" 

This would be a fairly useful study to engage in, in gr-neral- In 
this instances though , there are two drawbacks. Firsts It is not 
specifically suggested by the background information* Secondly, even though 
there are gaps^ there is a fair amount of information already listing about 
these stereotypes. 

Response to "2" 

If you found that men or women were more or less effective here 
you might make the inference that this skill reflects the broader ability 
of perception and empathy this Job specification designates* However, 
this inference is considerably weaker than would be desirable for making 
judgments about the relative worth of the two theories. 

Response to _"_3" 

This is a justified alternative in that if you support this 
hypothesis you have evidence that a decision for a woman is theoretically 
grounded* However, In suggesting this you still have the viability of the 
riva? theoiry: remaining* Too, If you don-t support the one hypothesis 
(from Theory B) you are left with no supporting evidence either way 
for a decision. 

Response to "4" 

NICE GOING. Though a little bit tricky to do, this is the most sure 
strategy to follow in order to answer the personnel question. This gives 
maximum likelihood of gaining needed support or needed disconf Irmation 
of the alternative theories* 

In retrospect, having used ^teore and Anderson's theory and attempted 
to incorporate their principles, I would like to emphasise from our experience 
the support we find for their advocation that a sociological theory should 
underlie the design of educational environments* (Cf * Moore's comments on this in 
Aldous e£ al. jl9710There are two reasons we have found for this* Firsts 
with a theory eKperience becomes transportable. Regardless of hardware, 
personnel, or educational substance, with a theory eKperlencea in one setting 
can be translated into another setting. One of the most striking things 
Ident in computer applications in education is the absence of such 
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theoretical underpinning* In my judgment this has constrained the 

reciprocal exchange of innovations among varied educational settings, 

A common observation in reports of computer applications is that successive 

settings find using other applications difficult Ce*g.s Wildgren^ 1971) • 
be 

Such use can/expedited by some theoretical underpinning of any educational 
innovation. Secondly , with a theory educational computing experience 
can be translated into the general store of information in sociology* This is 
a positive feature in itself (as, again, Moore and Anderson have shown with 
their important basic research being produced coincident with their 
programmatic efforts)* Also it provides a mechanism for blending teaching 
and research in university settings ~ a blend that is neither easy 
to effect nor stable, 

II. Educational Computing as a Site for Basic Research 

Some of the motivation for starting work on these simulations was my 
belief that tedmology was good and should be incorporated into the 
service of undergraduate education* Even though it was unclear at the outset 
what possible results there might be for education or for sociology* simply 
the interest in education and the interest in technology was a sufficient 
motivation* Now at thS-outset I knew that educational cc muting was an 
ambiguous locus of activity within a university department of sociology 
where by institutional self-definition there is a ralKture of teaching and 
research responsibility* This ambiguous character to educational computing 
was much more complex than the hackneyed "publish or perish" dichotomy 
or even the occasionally discussed differential evaluation of "basic research" 
and "applied research" in sociology. 
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More exactly, the problem ±s simply that the effort parameters and 
the potential yield (research or pedagogic) are very unclear* A computer 
application for instance can take a couple of hours to develop (as 5 say, 
a programmed learning experience) or take a matter of years to develop as 
with an elaborate simulation. However, the visible manifestation of either 
oay be a poor basis for determining the relative investments of time. 
Given this ambiguity, there are two prototypical solutions* One is not 
to do educational computing because it is risky within university reward 
structures* Or one can do it irrespective of this risk, purely because of 
general interests in education and technology* I began with the latter 
set of motivations, but^ ^strikingly, have been finding that the context of 
educational computing is a very rich source of basic research ideas* 
It can be a fertile source of information about social behavior. The 
implication of this finding is an additional confirmation that the teaching- 
research dichotomy is often a false one and that educational computing 
(or likely any concerted educational innovation) can provide strong inducement 
to those who have waivered before entering the arena because of their more 
archly non^applied theoretical and research interests* I irtll mention just 
two of the many research suggestions that have Merged- in order to illustrate* 
These are in addition to the more obvious possibilities we have explored 
such as sex differences in response to technology, differential applicability, 
of simulations to strong students and weak students, and differential 
applicability of simulations to class cohorts* 

A. First, our experience has turned up a number of intereatlng 
aspects of the anthropomorphist activity of human actors. From the use 
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of pronouns, computers are as often thpught to be male as neuter but rarely 
female. Computers can become significant refereiTce points for student self* 
conceptions p Often the reluctance of students to use technology has been 
that something might break or that the technology requires mechanical skill - 
Our experience is that as often as these constraints of usage are beliefs that 
"computers will think I am a dunnny If I make a mistake." Computers are 
held accountable for credibility and distributive justice. In our research 
simulations s we have tried to provide positive feedback when the student 
selects B correct option in the decision making. However ^ frequently 
students have been critical of the computer as "two-faced" or "unjust" 
because in use the student might select three wrong answers before obtaining th 
right answer. However * when he got to the right answer he found in the 
computer response that. a "well done" was provided ^ but this was hardly 
appropriate given the sequence of selections. 

B* Secondly^ the eKpressed intent of the research simulations was 
to provide training in the methodological subject matter ^ increase 
positive attitudes toward the coursef/^allow training in an area we felt 
was missed in customary methods courses s namely, the decision making 
connected with social research. We hoped the simulations would provide 
sufficient interest to reach some of these goals. Our eKpectations have been 
bbrn out Un part. Students performed about the same from being exposed 
to the simulations in terms of traditional course content* but they showed 
toprovements in decision making and judgment capacity , and there were 
evidences of increments in positive attitudes toward the subject matter. 
However, we have found a rather* emrious feature that in addition to 
doing the simulations with success in mlndj students frequentlyj after 
progressing through and doing their best to complete the simulations 



effectively, went through again so that they could have the feedback from 
selecting all of the wrong alternatives,. Now in a variety of ways this is an 
intriguing behavioral outcome. For example^ it relates to an important 
coBment made by Schlld (1966) about simulations* He suggest g that in 
simulations the actual skill that is learned may be to deal with the 
demand characteristics of the simulation or game itself , rather than what the 
game is actually trying to teach* Our experience of studenta going back 
through the simulations, though , to find out th^ feedback is that ^ ■ > 
there is considerably more motivational power in the games thmselves 
than the satisfaction of making a "correct" ^^c^ 

operating is not simply demand characteristics of hasty or successful 
completion* \ 
Actually this finding parallels a very Important possibility about 
a potential test of two theories in this setting* As mentionsds the 
theory underlying this Instance of educational computing is praised on 
an autotelic principle of education i namely, that the crucial motivational 
facet of the experience be intrinsic (that is, the simulations are worth 
doing irrespective of external reward). Opposed to this wuld be an educational 
model which relied for motivational purposes on external reward factors. The 
findings here' demonstrate that this may be a productive research site 
for testing such competing sociological theories of education 
(Moore and Anderson ys, Hmiblin et al. , 1969, e*g*). 



-13- 

III. Educational Computing % SjjaulatlQn§.i and Reform 

In hli 1966 presidential address to Che American Sociological 
Association^ Wilbert Moore spoke of the reformist tradition in sociology 
and Buggested the need for renewed thinking of a reformist nature within 
cont^porary socioiogy 19iS6). He did so while ^ploying the caveat 

of not identifying reform with value imposition or social engineering but by 
arguing that in so far as sociology is focused, on -interrelationships among 
properties and change the elements of reform are somewhat inherent to aociologioal 
concerns. In this last section/ I want to discuss the work on research 
simulations within the context of Moore -s statOTent. The intent here, 
as it has been throughout, is to add to a more broadly based linkage of 
edueatlonai simulations' and computing with the past and present state of 
soclulogy in general/ With only a minimum of license , it is possible to 
extract two themeo or implications of the refom tradition Mpore wants 
to reconstitute which can interface with efforts being Aindertaken in the field 
of educational computing. These themes 1 will call imaginative thought 
and self-reflection. The use of computers in education is an introduction 
of a new component in education, hence innovative and reformist. 
This coaiescence is not necessarily gotfd — as computers or reform are not 
Inherently 'positive* However/ in the Interest of articulating. a broad 
cbacsptlon of educational computing, this llntoge of computing and reform 
is %portant to Bmke explicit. Certainly it is a linkage which is a frequently 
articulated facet of the self-coQception of ptople engaged in computer : 
applications (note, in this regard, Kemeny, 1972 and Duke, 1974). 
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A, Firsts Inherent In the reformist thinking of ffoore is the idea 
of eociQlogists' imaginatively constructing social situations and their 
implications. This is literally what simulatione entail and as such 
simulating is located within Ifeore's intention* Barton (1970) makes this 
connection clear in categorizing simulations into four types (all conceptual, 
man^i^odeli man-^computer , and all computer based) | he places the conceptual 
thought at one end of a single continuum bounded at the other pole 
by fully computerized sittulations. 

Boocock and Schild indicated some eight years ago (1968) that if there is 
one greatest benefit from sij&ulations it is when students write than 
themselves* So far as I know this has not systematically bean implemented 
and described* Following the lead of the suggestion^ we have done this 
with students taking our methods course* Willingnass to undertake this 
activity has been evident sand the sentiment of those who have done this ™. /r 
is positive* We have learned that this systCTatic channel for studentj 
to add to the system of research simulations is an important one for 
a couple of reasons. For aKample, Moore and Anderson have spoken of the 
perspective of the referee as a role important for the learner* This 
is related to Mead's "generalized other that is , the ability to take 
into account the set of elements and relations in a system* Relatedly, there 
are very few avenues of applied activity for students in sociology despite- 
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the fact that this is frequently a factor for selecting sociology as a major. 
We have operated with the assumption that there is no better domain for 
itudents to eKercise the referee perspective or find applications for 
theoretical inf oration than one's own educational enviromient . 
(Similar sentiments to these are expressed in Of she, 1970 and Postman, 1975.) 



B. Secondly, in Itoore's tarns refome antall aelf-^reflection^* 
That is, they imply evaluation. Parhapg a useful juKtaposition to make 
with Moore's work is Donald Campbell's notion that reforaa ahoulrt be 
eKperlmente (1969) * Campbell begins : "The United States and other modern r ■ 
nations should be ready for an eKperimental approach to social reform 
[read 'educational reform' J , an approach in which we try, out new programs 
'designed to cure apeelflc social problMiSj in which we learn whether or 
not these programs are effective, and in which we retain^ Imitate* modify 
or discard them on the basis of apparent effectiveness on the multiple 
imperfect criteria available" (409) . It smmim to me that , educational 
computing has importantly aligned itself in Its.efforts with reform but is 
not yet incorporating the implication in Moore and Campbell's stat^ents 
for self --reflection. 

I wanted to get an idea about the ^tentto-which this self --reflection : v 
underlies educational computing in sociology so 1 read in sequence the 39 
social science applications that have appaared inv the proceedings of the V 
conferences on computers for the- undergraduate curricula from >1 970 to 1975 • 
I looked for three features: (1) whether evaluative statements- 
were made in the report; (2) whether evaluation was impressionistic » 
syst^iatic, or used some control procedurei and (3) whether results reported 
were positive s negative p or mixed* Thirty-four of the thirty-nine made 
eyaluative statraents. Of these , ten were positive (no negative remarks), 
24 were mixed p and none were solely negative. In four of the reports s systematic 
evaluation was reported (l*e- , were empirical, provided explicit procedures, 
characterized the entire distribution of evaluated entitles) * In one of 
these, there was something approximating a controlled experiment where a ' 
group eKposed to a computer application was compared to a group exposed 



to another taaching device (Cutler, 1973). In mentioning thlg, it Is 
done empathlcally* Thera are anormous problems Involved In such evaluations: 
vm major onei being the problem of privacy (Meyers ^ 1971) and the problam 
of iimultaneotisly Inatltutlng.the evaluation and the Innovation. I do so 
for two reasons. The first is that^my own evaluation has. produced mixed 
results^ my own Impressionistic evaluation that the simulations are valuable 
notwithstanding* The second Is that in light of the aocial organlzatlQiaal 
facets of edueational computing (involving the technology , but also 
university departments and administrations ^ regents^ and legislatures) and 
the stakes Involved ^ the mention of the tie with Cmipbell^s message about research 
in the political sphere Is not simply analogical but ^ substantive. ; 

The basic evaluativa design used in the Implementation and evaluation—--*- 
of these research simulations is randomly to assign one^half of the class to 
the simulations the first half of the semester and one-half to a control 
condition. The places are reversed the second half of the semester 
(Figure A below). This Is not Inequitable since all will eKperlenca 
the simulations and the facilities will comfortably support only ona-»half of 
the class at any one time. At mid --term we make an evaluation which has included 
several measures of attitudeSj an evaluation of increments in the basic 
content of the courses and in one of two periods of evaluation a rather 
involved assessment of increments of research judgment capacity - 
The design also allows an evaluation at the end of the course ^ but because 
at that point both groups have received the treatment, interpretation of ^^^^^^^^ ^^^^^^^^^ v?^^^^^ 
those results have been somewhat complex and are not provided here. In^^^^^^^^^^^^ ^ k v 

the first of two evaluation instances, 1974^ our result s showed no 

significant increment in content knowledge, some evidence of incr^ient :\A:':^i 
in positive attitudes toward the f*ubject matter of research methods, . f i 



and a fairly strong Increment in decision making or judgment eapaaity 
(Wletlng, I97S). In 1975 we repeated the assessment of attitudes ' 
and contents leaving out the assessment of judgment capaolty, (a proeedure 
which has proved to ba particularly time consuming). The ifesults for 
both years are provided in Tables 1 and 2 below. Our results from 1975 
approximate those from 1974 ^ but the evidence for attitude increment is 
even more tentative than in the 1974 results ^ 

Referring now to the possible politieal faceti"of self ^reflections 
I was alerted to this issue by the title and sub--title of an article 
in a recent issue of the Chronicle of Higher Education 1976): . 

"Computerized Education: Time to Sink or Swim (So Says the N» S*F* , 
imich Has Invested over $14-million in Two Teaching SystOTs)-'^ The 
article is speaking of N.S.F. Investment in PLATO and TICCIT and implied 
pbsltive evaluation should be forthcoming to warrant the expenditure . 
I take from this not that educational computing should begin ^ t^^^^^^^ 
as if it was backed up against the wall* ftit the realities^ it se 
to me* are that such a point of view as represented in this particular 
report makes of educational computing very much\a political; situation * . 
hence the tie with what Campbell is saying. The options that Campbell 
describee may in fact be emerging for those involved in educational 
eoffiputing. On one hand the option may be forced for persons in-educat^i^ 
computing as with political reformers to promise positive effects before 
Che fact- The other option, \^lch Is wHat Campbell advocates for 
reforms, Is to avoid the ultimately self-defeating nature of the first by 
emphasizing coiOQitment to problems rather than specific solutions , to educate 
the public to the necessity of coupling hard-'nosed evaluation with 
reformist' activity, and to undertake in the process of reformist activity 
very careful evaluative steps- 
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. , 1974 Evaluation 

■ - .^ ■ _ ■ ■ ■ - ■ S16.: L|gVEL ■ 

VARIABLE ' \ GROUP N x ' "t" value ' ^ne^ ta^ed) 



CONTENT 


Group A - 
Group B 


20 - 
19 


11.60 
ill .10 ■ 


' .47 


. — n—f — . 


; _ MITITDDE 
(LliffiRT) 


Group A 
Group B 


21 
25 


3.76 
3.65 


.59 




_ ATTITUDE 
III. (EVALUATIVE) 


Group A 
Group B 


21 
25 


5.57 

5.12 


1.72 


p X -05 


ATTITUDE 
(POTENCY) 


Group A 
Group B. 


21 
25 


5.00 
4.43 


2.49 ' 


p ^ ;oi 


ATTITUDE 
^* (UlDERSTANDINq) 


Group A 
Group B 


21 
25 


4.71. 
4.16 


1.59 


p ^ -10 


- jm^ffiNT 
SKIUL 


Group A 
Group B 


21 
25 


25.00 
18.64 


2.45 

' - - 


p ^ ,01 

L„ _ _ 



Dlffamt N* 9 reflect different levels ef participation at some stage of 
thm laplesBsat^tlcm/evaluation (a.g.j absence, not campletlng slmylatlo^B). 
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Mai®' ^ 

O ..p|i4^^^-!^^;^7;;r-:' 



ERIC 



1975 Evaluation 





V^IABLE 


GROUP 






"t" value 


SIG. LpVEL 

(one- tabled) 




CONTENT 


Group A 
Group B 


21 
24 


28.43 
28.17 . 


.17 . 


N.S. . ; 


II. 


ATTITUDE 

(mmmy 


Group A . 
Group B 


20 
24 


3.78 
3.50 


1.87 


P ^ .03 


III. 


ATTITUDE 
(EVALUATIVE) 


Group A 
Group B 


20 

24 


5.43 
5.32 


.44 


N.S. 


IV. 


ATTITUDE 
(POTENCY) 


Group A 
Group B 


20 
24 


4.88 
4.87 


.03 


N.S. 


V, 


ATTITUDE 
(tnroERSTANDINQ) 


Group A 
Group B 


20 

24 


4.82 
4.32 


1.56 


P ^ 'lO 



Diffar^t N's raflaet diffarenc levels o£ participation ac lose stage of 
the l^laietttatloQ/evaluatlon (stg^, abseDca. not completing Simula tiofia). 
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Figure A* 



Dlagraimnatlc Summary of Design 



Stage 1 . ~ Stage 2 



R Group A 



E Group B 




Group A ^ Group which used simulations first hal 

control in second half of eamester* . ^ v . 

Group Group which was control In first hall of semesteri . used. . 
simulations in aacond half of semester, 
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Figure 



THE FOLI^WING QUESTIONS ^ASK ABOUT. Y THE SUBJECT MATTER 

OF RESE^CH MSTHODOLOGt, IN lEACH^ CASE PLMSE SELECT THE ALTmNATIVE THAT BEST 
RCTMSENTS YOUR OWN ATTITWDE T0WAK3 THE SUBJECT MATTM OF EESmCH METHODOLOGY. 

YOUR ^STORS WILL HAVE NO BEARING ON HOW YOU ARE EVALUATS) IN THE COURSE, 
INCLUDE ONLY YOUR STUDEOT mJtmm Am NOT YOUR NMIE. NO ANALYSIS OF THE RESULTS 
WIUL BE MADE UNTIL GRADING IN THE COURSE MS BEEN COMfLETED , : 

PLEASE NOTE THAT THE QUESTIONS ARE ORiraTm TO THE SUBJECT MATTER OF RESEARCH 
IffiTHODOLOGY. THUS, TRY TO RESPOND IN TEIMS OF THIS FOCUS RATHER THAN OTHER 
MATTmS SUCH AS YOim AOTITUDE TOWA^ SOCIOLOGY GENEMLLY, PKSONS INSTOUCTING IN 
THE COURSE* TOE U of IOWA SOCIOLOGY DEPffiTMENT, THE UNIVERSITY OF IOWA, AND SO ON* 

1, Research methodology la useful for mhe underatandlng of sociology articles 
and books. 

( ) ( ) ( ) ( ) . ( ) 

Strongly Disagree Neutral Agree Strottgly 

Disagree Agree 



2* Contact with the subj-ct matter of research mathodolagy is useful for 
better performance in other sociology coursGSp 

( ) ( ) ( ) ( ) C ) 

Strongly Disagree Neutral Agree Strongly 

Disagree Agree 

3p 1 am better able to evaluate the arguments of sociology instructors from 
having studied research methodology, 

( ) ( ) ( ) < ) < X 

etrongly Disagree Neutral Agree Strongly 

Disagree Agree 

4. The subject matter of research methodlogy is not useful for my future 



( ) < ) ( ) < ) < ) 

Strongly Disagree Neutral Agree j Stroi^ly 

Disagree . Agree 

5. The information provided by research methodQlogy Is useful for dealing 
with practical problans in society, 

( ) ( ) ( ) >C ) < ) 

Strongly Disagree Neutral Agree Strongly 

Disagree Agree 

6, In general I am riot Interested In the subject matter of research methodnloBy- 

i ) i } ■ ...(■■ );■ ■■ c y '^- '-'y^-\ -c' -)-' \ ■■■■■■ 

Strongly Disagree Neutral Agree Strongly 

Disagree Agree 



. Figure C. 

THIS CONCERNS THE WAYS INDIVIDUALS THINK ABOUT WOEDS, THINGS, OR IDEAS. 

mow YOU WILL FIND A THING (IN THIS CASS "RESEARCH MmiODOLOGY") , MARKED IN A BDX. 

THIS IS FOLLOWED BY SEVIHAL ADJECTIVE ?AIRS WHICH HAVE OPPOSITE tffiANINGS 
(such as "good" as opposed to "bad"). . 

FOR EACH OF THE MARKED OFF WORDS ^ PLACE A CHECK MARK { v^) AT A POINT BETWEEN 
EACH OF TIffi ADJECTIVE PAIRS WHICH FOLLOW IT. THAT IS, PLACE ME CHECK SOMEWHERE 
BETWEEN EACH PAIR OF ADJECTIVES WHICH WILL SHOW HOW CLOSE IN MEANING YOU FEEL THE . 
MARKED OFF THING IS TO EACH OF THE ^JECTIVES IN THE SEVERAL PAIRS. FOLLOW THIS 
PROCEDURE FOR EACH PAIR OF ADJECTIVES. 

FOR E^IPLE, IF YOU FELT A WORD SUCH AS SCHOOL HAD A MEANING MtDWAY BETWEEN THE 
ADJECTIVES "good" and "bad" YOU WOULD ANSWER FOR THAT ADJECTIVE PAIR IN THE 
FOLLOWING WAY. 



Good 




Bad 



I RESEARCH ttlTHODOLOGY 



Good ^ 
Familiar 



Significant - 

Strong 
Meaningful ^ 
Iffiportant 
Vigorous 
Understandable ^ 



^ Bad 

_ PowerlasB 
Strange 
Insignificant 
Weak 

Meaningless 
Unimportant 
Feeble 
Mysterious 
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* M* Kenneth Brodyj Dan Sehoutenp and Joal Kallich assisted in the preparation 
of this paper j and I am pleased here to acknowledge their contributions* 



As a stylistic option^ a striking literary representation of three of these 
principles exists in John Earth -a portrayal of Henry Burlingame ■ s teaching 
techniques in The Sot-weed Facto r (1973 i7t 8). "He found both to be rapid 
learners, e:specially apt in natural philosophy , literature , composition, 
and music i less iO in languages ^ mathematics , and history. He even taught 
them how to dance^ though Ebeneger by age twelve was already too ungainly 
to do it well. First* he would teach Ebenezer to play the melody on the 
harpsichord J then he would drill Anna In the steps s to Ebenezer's 

accompaniment, until she mastered themi next he would take Ebenezef's place at the 
Instrument so that ^na could teach her brother the steps; and finally, 
when the dance was learned, Ebenezer would help Mma master the tune on the 
harpsichord. Aside from its obvious efficiency^ this syst^ was In keeping 
with the second of Master Burlingame's three principles of pedagogy | to wit, 
that one learns a thing best by teaching it. The first was that of the three 
usual motives for learning things — necessity, ambition, and curiosity " 
simple curiosity was the worthiest of development, it being the; -purest*, 
(in that the value of what it drives us to learn is teminal rather than 
instrumental J the most conducive to exhaustive and continuing rather than 
cursory or limit ad study, and the likeiiast td render pleasant ■ the labor of 
learning. The third principle, closely related to the others, was that this 
sport of teaching and learning should never become associated with certain hours 
Or particular placesj lest student and teacher alike (and In Burlingame -s 
ayatem they were much alike) fall Into the vulgar habit of turning off their 
alertness, except at those time and in those places^ and thus make by 
toplication a pernicious distinction between learning and other sorts of 
natural behavior*" 

Additional ideas for research on the sociology of computing and computers 
within educational contexts are found in Anderson and McTavish (1970) . 
An important issue on which information is starting to be collected concerns 
the diffusion of ideas about computers and. computing contescts into the 
general culture. Illustrative of this kind of Interface 'is' a statement 
by Mderson and Wietlng (1973). A striking Illustration of the diffusion of 
Information about computers of particular relevance to our use. of Moore and 
Anderson's "responsive envlroiwents" notions was the observation of a ' 
literary allusion to th^ in Williim^GBddl^' recent novel, JR (1975:224). 

%t is important also to note the complmentarlty between simulation activity 
(i.e. , toaginative constructions of social systems and; their implications) 
and theories of human development . The work of Piaget (1971, e.g. )and the 
Interface of simulating and formal operational thought is particularly 
intriguing. 

^To measure the basic content of sociological methods ^ a random sample of 25 items 
(40 in 1975) was drawn from the pool of final test items com^ over the ..-.^-r^-v 
previous years that the course was offeredi These were multiple choice Items and\ 
covered standard methods text and lecture material. To measure attitudes 
toward the subject mtter^ a STltCTa scale with Likert response format was used. 
Also, a smantlc differential format was provided to assess attitudes toward 
methodology. The phrase "research methodoiogy" was used as the stimulus* . 
A group of 9 adjective pairs was used with a J^point scale for each* Three pairs 
came from an evaluative pool; 3 came from a potency pool | 3 came from an 
under standablllty pool. 



To measure some practical or judgment capacity for conducting reaearchi 
a paper-and-pencll Instrument was developed* This essentially asked whether 
students could think of implications of a theoretical nature, of a practical 
nature, and of a research design nature when confronted with a hypothetical 
substantive topic* 



26 



0 



References 



AldouSf Joan eC al« 

1971 Family Problem Solving, Mnsdales Illinois: The Dryden Press, Inc, 

Anderson p Ronald E. and Donald G* McTavish 

1970 "Sociology and ^tass Undergraduate Education*" Pp. 8*35-^8*39 

in Proceedings of a Conference on Computers in the Undergraduata 
Curricula* Iowa City: University of Iowa. 

Anderaonj Ronald E. and Stephen G, Wleting 

1973 "The Seeing of Graphic Stimuli i The Case of Cartoon Images," 
Presented at the annual meetings of the North Central 
Sociological Society s Cincinnati, Ohio* 

Barth, John 

1973 The Sot-weed Factor, New York: Bantam* 
Barton^ R,F, 

1970 A Primer on Simulation and Gaming, Englewood Cliffs, N.J,: 
Prentice-Hall, 

Booeockj S,S. and E.O, Sehild ^ 

1968 Simulation Games and Learning* Beverly Hills: Sage* 

Campbell, Donald T, 

1969 "Reforms as Experiments," American Psychologist 24 (April): 
409-429, 

Cutler, Stephen J. - 

1973 "Current and Retrospective Student Valuation of a Computer Based 
Research Curriculum in an Introductory Sociology Course." 

Pp, 236-241 in Proceedings of a Fourth Conference on Computers 
in the Undergraduate Curricula* Claremimt^ Calif qrnlai The 
Claremont Colleges. 

Cutler s Stephen J, and David V, Blagg . 

1971 "Computer Applications in the Undergraduate Boclology 
Curriculum at Oberlin College." Pp, 371-377 in proceedings 

of the Second Annual Conference on Computers in the Undergraduate 
Curricula. Hanover, New Hampshire i Dartmouth College* 

Duke, Richard D. 

1974 Gaming: The Future's Language, New York r Ifals ted. 

Gaddis, Willlm 

1975 JR, New York: I&iopf. ' 

Hamblini R.L. et al, 

1969 "Changing the Game from *Get the Teacher' to 'Learn- *" 
Transaction (January) |20-31> 



27 



Kemeny, John 

1972 Man and the Computer. New Yorki Scribner^s. 



Magarrall, Jack o 
1976 "Coffiputeriged EducationiTime to Sink or Swim*" 

The Chronicle of Higher Education 12 (April 26) i Iff* 

Meyers s Edmund D,^ Jr. » 
1970 "MRESS and Undergraduate Education in the Social Sciences." 
Pp, 8,23-8.27 in Proceedings of a Conference on Computers 
in the Undergraduate Curricula. Iowa City I University of Iowa* 

1970 "We Don't fciow What We are Doing." Pp. 159-169 In Proceedings 

of the Second Annual Conference on Computers in the Undergraduate 
Curricula. Hanover ^ New Hampshire i Dartmouth College. 

Moore s Wilbert E. 

1966 "The Utility of Utopias*" Anerican Sociological Review 31 
(Dec^ber) i765-772* 

Moore* Omar K. and A.R* Anderson 

1969 "Some Principles for the Design of Clarifying Educational 
Enviroranents." Pp. 571-613 In D.E. Goslin (edO* Handbook 
of Socialization Theory and Research* Chicago: Rand McNally. 

Of she J Richard <ed.) 

1970 Sociology of the Possible. Englewood Cliffs, N.J*f Prentice-Hall* 

Piagat* Jean and Barbel Inhelder 

1971 La Psychologie de I'enfant. Paris: Presses Unlversltairesde 

France. 
Postman, Nell 

1975 "A Fable Whose Time Has Come." New York Times ^tegaE;ine 12 
(October) 170-82. 



1970 Proceedings, of a Conference on Computers in the Undergraduate 
^Curricula* Iowa City: University of Iowa. 

1971 Proceedings of the Second Annual Conference on Computers 
in the Undergraduate Curricula. Hanoverj New Hamp|hire: 
Dartmouth College* 

1972 Proceedings of the 1972 Conference on Computers in Undergraduate 
Curricula* Atlanta, Georgia. 

1973 Proceedings of a Fourth Conference on Computers in the Undergraduate' 
Curricula. ClarOTont, California i The Claremont Colleges* 



28 



1974 Proceedings of the Conference on Computers in the Undergraduate 
Curricula. Pullman, Washington; Washington State Uniyerslty. 

1975 Proceedings of the 1975 Conference on Computers In the Undergraduate 
Curricula. Fort Worth, Texas i Texas Christian Universlty- 

Schlld, E.O. , ^ ^ ^ 

1966 "The Shaping of Strategies," ^erlcan Behavioral Scientist 

12. (July--August) i7-13. 

Wietlngs Stephen G, ^ 

1975 "Simulated Research Experiences for Use in Teaching Kesearcn 
Methods." Teaching Sociology 3 (October) i 33-59. 

Wildgrenp John K, ^ ^ ^ j a . 

1971 "Computers and Undergraduate Training in an Underdeveloped Area. 
The Case of Louisiana State University." Pp* 152-158 in 
Proceedings of the Seeond\tonual Conference on Computers in 
the Itadergraduate Curricula. Hanover , New Hampshire i 
Dartmouth College. 



